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When is Eaton's Markov chain irreducible? 
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Consider a parametric statistical model P{Ax\6) and an improper prior distribution u(d6) that 
together yield a (proper) formal posterior distribution Q{A6\x). The prior is called strongly ad- 
missible if the generalized Bayes estimator of every bounded function of 9 is admissible under 
squared error loss. Eaton [Ann. Statist. 20 (1992) 1147-1179] has shown that a sufficient con- 
dition for strong admissibility of v is the local recurrence of the Markov chain whose transition 
function is R{0,dr]) = J Q{dr]\x)P{dx\6). Applications of this result and its extensions are often 
greatly simplified when the Markov chain associated with R is irreducible. However, establishing 
irreducibility can be difficult. In this paper, we provide a characterization of irreducibility for 
general state space Markov chains and use this characterization to develop an easily checked, 
necessary and sufficient condition for irreducibility of Eaton's Markov chain. All that is required 
to check this condition is a simple examination of P and v. Application of the main result is 
illustrated using two examples. 

Keywords: improper prior distribution; local recurrence; reversible Markov chain; strong 
admissibility 

1. Introduction 

Consider a parametric statistical decision problem with sample space X and parame- 
ter space 6. Both X and Q are assumed to be Polish spaces equipped with their Borel 
cr-algebras B{X) and B{Q). Suppose that P:B{X) x 9 ^ [0,1] represents a parametric 
statistical model, that is, for each 6, P{-\6) is a probability measure and, for each A, 
P{A\-) is a measurable function. As usual, the idea is that we will observe a random 
element whose distribution is P{dx\9), the goal being to use the observation to make in- 
ferences about the unknown parameter 6. This will be done within the Bayesian paradigm 
using an improper prior distribution. In particular, let v^dO) denote a cr-finite measure 
with iy{&) = oo. Define the marginal measure as 

M{dx)^ [ P{dx\e)i^{d0). 
Je 

Eaton [2] shows that if M is a-finite, then there exists a formal posterior distribution Q, 
defined as follows. 
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Definition 1. A function Q : S(8) x X ^ [0, 1] is called a formal posterior distribution 
(FPD) if: 

1. Q{-\x) is a probability measure for each x; 

2. Q[B\-) is a measurable function for each B; 

3. 0(d6l|a:)A/(da;) = P{dx\e)v{de) , that is, for all A G B{X) and B e B{Q), 

[ Q{B\x)M{dx)= [ P{A\e)i^{de). 

J A Jb 

The FPD is unique in the sense that if Q is another FPD, then there is an M-null set 
Aq such that x ^ Ao imphes Q{d9\x) = Q{d9\x). Throughout this paper, M is assumed 
to be CT-finite, so an FPD is guaranteed to exist. We now briefly describe a method of 
evaluating improper prior distributions that is due to M.L. Eaton. (For a more in depth 
review of this area, see Eaton [4, 6].) 

Consider the problem of estimating a bounded, real-valued function "f{9} under squared 
error loss. Of course, the formal Bayes estimator of ^{9) is 7(2;) = jQ^{9)Q{d9\x). The 
risk function of a generic estimator, say S, is its mean squared error, that is, 

ri5,9)^ [ iSix)^-fi9)fPidx\9). 

The estimator d is called almost-v- admissible if for any estimator 5' such that 

r{5' ,9)<r{5,9) V6' G 8, 

the set {9 G Q:r{5' ,9) < r{S,9)} has z^-measure zero. If P{dx\9) and i'{d9) combine to 
yield an FPD that generates (almost) admissible estimators for a large class of functions 
of 9, then we would be willing to endorse as a good "all purpose" prior to use in 
conjimction with the statistical model P{dx\9). This idea provides motivation for the 
following definition. 

Definition 2. The prior v is called strongly admissible if 7 is almost-v -admissible for 
every bounded, real-valued function 7. 

Eaton [3] developed a sufficient condition for strong admissibility that involves the 
Markov transition function R:Q x B{Q) — > [0, 1] given by 

R{9,dr])^ [ Q{dri\x)P{dx\9). 

Before we can state the result, we need a couple of concepts from general state space 
Markov chain theory. Let W = {Wn}'^=o denote the Markov chain on 6 driven by R 
and let Pig denote the overall probability law governing the chain when Wq = 9. For 
B G B{Q), let aB denote the first return to B, that is, 

as = min{n > 1 : Wn G B}, 
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with the understanding that (Tb = oo if Wn G B for all n > 1, where B denotes the 
complement of B. 

Definition 3. The Markov chain W is called locally-z^-recurrent if, for each B with < 
iy{B) < oo, the set 

{9eB:PTg{aB<oo)<l} 

has v-measure 0. 

In words, the chain is locally- i/-recurrent if, when started inside the set _B, aside from 
a set of starting values that has i/- measure 0, the chain returns to B with probability 1. 
Note that, unlike the standard definition of recurrence (see, e.g., Meyn and Tweedie [11], 
Chapter 8), this definition pertains to both reducible and irreducible chains. Indeed, 
just before defining local-i^-recurrence on page 1174, Eaton [3] states: "The following 
definition, a modified notion of recurrence, allows us to circumvent a discussion of irre- 
ducibility issues while relating our previous admissibility results to the recurrence of Vl^." 
The following was proven in Eaton [3] (sec also Eaton [5]). 

Theorem 1. IfW is a locally-v -recurrent Markov chain, then v is a strongly admissible 
prior. 

Establishing local-i/-recurrence directly using the definition (or the characterization 
based on the Dirichlet form of R) is typically infeasible. However, if W is ^^-irreducible, 
that is, any set B with v{B) > is accessible from any 9 E<d, then recurrence and local- 
z^-recurrencc arc equivalent (Eaton, Hobert and Jones [7] ) . Hence, if z^- irreducibility of W 
can be demonstrated, then all of the techniques that have been developed for establishing 
recurrence can be brought to bear on the problem. Indeed, nearly all of the applications 
of Theorem 1 have involved first demonstrating that W is j/-irreducible and then showing 
that W is recurrent. Examples can be found in Eaton [3], Hobert and Robert [9], Hobert 
and Schwcinsberg [10] and Hobert, Marchev and Schweinsberg [8]. Similarly, Eaton et al. 
[7] have recently extended and generalized the theoretical results of Eaton [3] and Hobert 
and Robert [9] under the assumption that the chains of interest are irreducible. 

There is one very simple sufficient condition for i/-irreducibility of W and this was used 
in most of the applications mentioned above. If the support of the statistical model does 
not depend on the parameter, that is, if the set {A G S(X) ■.P{A\0) > 0} is the same for 
all 6* e 6, then W is i^-irrcduciblc (Eaton et al. [7]). Until now, however, there has been 
no easy way to check for i^-irreducibility of Eaton's Markov chain when this condition 
fails. In this paper, we provide an easily checked, necessary and sufficient condition for v- 
irreducibility of W. This result cannot be stated precisely at this point, but the sufficiency 
half, which is the practically important part, can be. 

Theorem 2. The Markov chain W is v -irreducible if there do not exist two sets A G B{X) 
and C G S(0) with the following properties: C is non-empty, v{C) > 0, P{A\6) = for 
every eC and PiA\9) = for v-almost all 9 eC. 
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This result allows one to establish z/-irreducibility of Eaton's Markov chain through 
a simple examination of P and i>. Neither the posterior distribution Q nor the Markov 
transition function R is required to check the condition. It is interesting to note that if 
the sets A and C do exist, then P{dx\9) and P{dx\6') are mutually singular probability 
measures whenever 9 € C and 9' Q C (aside from a i/-null set of S's in C). Thus, the 
statistical model is, in a sense, an artificial concatenation of two different models. 

The remainder of the paper is organized as follows. Section 2 contains a new charac- 
terization of irreducibility for general state space Markov chains. This characterization 
is used in Section 3 to prove the main result. Application of the main result is illustrated 
in Section 4. 

2. A characterization of irreducibility for general 
Markov chains 

Let S{y,dz) be a Markov transition function on a general state space (Y,S(Y)), as 
described, for example, in Meyn and Tweedie [11], Section 3.4. Denote the corresponding 
Markov chain by F = {F„}^^o- For n £ N := {1, 2,3,...}, let S"{y, dz) denote the 7i-step 
Markov transition function corresponding to S, which is defined inductively by 



where = S. Of course, 5'"(y, A) = Pry{Yn £ A), where Prj,(-) denotes the overall law 
governing Y on Y°°, assuming that Yq = y. Let ip denote a non-trivial, cr-finite measure 
on (Y,;B(Y)). The following is a standard definition of irreducibility for general state 
space Markov chains. 

Definition 4 (Meyn and Tweedie [11], page 87). The Markov chain Y is called Lp- 
irreducible if, for every measurable A with ^p{A) > and every y gY , there exists an 
hGN (which may depend on y and A) such that S"'{y,A) > 0. 

In words, (ys-irreducibility means that every set A with ip{A) > is accessible from any 
y S Y. We will call the Markov chain ip-reducible when it is not (/3-irrcduciblc. that is, 
when there exist y and A with ip{A) > such that S"(y,A) = for all n e N. We will 
sometimes find it convenient to apply the descriptions "(^-irreducible" and "(/j-reducible" 
to the Markov transition function S. Our first result shows that if the chain is (y9-reducible, 
then we may assume that y G A. 

Proposition 1. The Markov chain Y is ip-reducible if and only if there exists A G S(Y) 
with Lp{A) > and y eA such that S'"(j/, A) = for all n 6 N. 



Proof. The sufficiency part is obvious. Now, assume that the chain is i^-reducible, so 
there exist y £ Y and A G B{Y) with ip{A) > such that S"{y,A) = for aU n G N. 
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li y & A, then there is nothing to prove, so assume that y € A. We will establish the 
existence oi y' G A such that S'^{y' , A) ~Q for all n G N. First, for each to G N, define 

Bm = {w^A:S"'{w,A)>Q], 

and set B = lJm=i Now, fix m G N and note that 

= 5™+i(y,A)= / 5™(z,A)5(y,dz)> / 5"(z,^)5(y,dz). 

Since S"^{z,A) > for z £ B„i., we must have S{y,Bm) = 0. But this result holds for 
every to G N, so it follows that S{y,B) = 0. Note that Y can be partitioned into A, B 
and 'A\B and we know that S{y,A) = S{y,B) = 0. Therefore, S{y,'A \ B) = 1, which 
implies that A\B \s not empty. Clearly, any y' £ A\B satisfies S"{y',A) = for all 
nGN. □ 

In the classical case where Y is countable, the chain is called irreducible (with no prefix) 
if, for each i,j G Y, there exists an n G N such that S^{i, {j}) > 0. This is equivalent to 
c-irreducibility, where c denotes counting measure on Y. In this context, a non-empty 
set C C Y is called closed if, once the chain enters C, it cannot leave. Formally, C is 
closed if Xijec "^(^j 0}) = ^ i £C. Obviously, the state space Y is closed. In fact, 

the Markov chain is irreducible if and only if Y has no proper, closed subset (see, e.g., 
Billingsley [1], Problem 8.21). We now extend these ideas to handle Markov chains on 
general state spaces. 

Definition 5. A set C G Biy) is called closed if it is non-empty and S{y, C) —0 for all 

yeC. 

The following is the general state space version of the result in Billingsley's [1] Problem 
8.21. 

Theorem 3. The Markov chain Y is tp-reducible if and only if there exists a closed set 
C with ip{C)>0. 

Proof. To prove sufficiency, suppose that C is a closed set with ip(C) > 0. Assume that 
for some n G N, S"{y, C) ~0 for all y E C. Then, for any y <E C, we have 

5"+i(2/,C)= / S^{z,C)Siy,dz)^ [ 5"(z,C)5(y,dz) = 0. 

Hence, by induction, S'^{y,C) = for all y £ C and all n G N. Therefore, since C is 
non-empty and (p{C) > 0, the chain is (/9-reducible. 

Now, to prove necessity, assume that the chain is (/s-reducible. By Proposition 1, there 
exist a measurable A with (p{A) > and a. y e A such that S"{y,A) = for all n G N. 
For each m G N, define 

= {u-gY:S""(w,A) >0} 
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and set B = lJm=i ^"i- ^^^^ show that the measurable set C := A D B is the closed 
set that we seek. First, y S C, so C is non-empty. Now, suppose that y' G C is such that 
^(y',^) >0. Then, 

S{y', A) + S{y\ B) > S{y', AUB) = S{y\C) > 0. 

Since y' e C ^ y' e B ^ y' e Bi, we know that S{y', A) ~ 0, so it must be the case that 
S{y', B) > 0. Hence, there must exist a fc e N such that S{y' , Bk) > 0, which implies that 

S^+Hy',A)^ [ S'^iz,A)Siy',dz)= [ S'^iz,A)Siy\dz) > 0. 

Jy JBk 

But this implies that y' G Sfc+i, which contradicts the fact that y' G C. Therefore, it 
must be the case that S(y^ C) = for all y G C and this implies that C is closed. Finally, 
ipiC) > ifi{A) > 0. ' □ 

In the next section, we use Theorem 3 to develop an easily checked, necessary and 
sufficient condition for i/-irreducibility of Eaton's Markov chain. 



3. Conditions for irreducibility of Eaton's Markov 
chain 

Eaton [3] studied the Markov transition function 

R{e,dr])= [ Q{dr]\x)P{dx\e), 

where P is the statistical model and Q is an FPD. Since any FPD can be used to construct 
R, R is not unique. For example, if Q ^ Q is another FPD, then 

R{e,drj)^ f Q{dr]\x)P{dx\e) 

is an equally valid version of the Markov transition function. However, the following 
result shows that R enjoys a uniqueness property similar to the uniqueness property of 
the FPD that was discussed in Section 1. 

Proposition 2. If R and R are two different versions of Eaton's Markov transition 
function, then there exists a v-null set Bq G B{Q) such that 9 <^ Bq implies R{9, •) = 
Ri9,-). 

Proof. Since Q and Q arc both FPD's, there exists an i\/-null set Aq such that x ^ 
Aa Q{d9\x) = Q{d9\x). Fix B G ^(9) and note that 

R{9,B)- R{9,B)^ I [Q{B\x) -Q{B\x)]P{dx\9). 
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Now, since = M(Ao) = P{AQ\0)i'{d9), there exists a i^-null set Bq such that 
P{Ao\e) = for all 6* G Bq. Hence, OiB^^ R{0,B) = R{0,B). Finally, note that Aq 
is determined by Q and Q, and Bq is determined by Aq. Therefore, Bq does not depend 
on the set B, so 9 <^ Bq^ R{B, •) = R{B, ■). □ 

Remark 1 . An important consequence of Proposition 2 is that cither all versions of R 
are locally- z/-recurrent, or none of them is. 

Every FPD satisfies P{dx\9)v{dd) ~ Q{<19\x)M{dx) and it follows that every version 
of R is reversible (or symmetric) with respect to that is, if / and g are bounded, 
real- valued functions on 0, then 

/ [ f{9)g{rt)R{9Av>{d9)= [ [ fi9)gir^)Rir^,d9Mdrj). 
JeJe JeJe 

This property is key in the proof of our main result, which we now state and prove. 

Theorem 4. There exists a v-reducible version of R if and only if there exist a non- 
empty set C e B{Q) with v(C) > and another set A g S(X) such that P(A\9) = for 
every 9 e C and P{A\e) = for v-a.e. OeC. 

Proof. To prove sufficiency, suppose that A and C exist. Using property 3 of Definition 1, 
we have 



Q{C\x)M{dx) = j_P{A\9)u{d9) = 0. 
Jc 



Hence, if 

D = {x'eA:Q(C\x)>Q}, 

then M{D) = and, obviously, Q(C\x) = for a\\xeA\D. Fix 0o e C and let <5eo(d6') 
denote a probability measure concentrated on the point 9q . Now, define 

Clearly, Q satisfies the first and third properties of Definition 1. Moreover, we show in 
the Appendix that, for any B G B{Q)^ Q{B\-) is measurable. Therefore, Q is an FPD and 
we now show that 



i?(0,dr/)= / Q{dri\x)P{dx\B) 
Jx 

is the j/-reduciblc version of R that we seek. By construction, Q{C\x) = for all x G A. 
It follows that, for every 9 £ C, 

R{e,C)= [ Q(C\x)Pidx\9) [ Q(C\x)Pidx\9)^0. 



648 



J. P. Hobert, A. Tan and R. Liu 



Consequently, C is a closed set with z/(C) > and it follows from Theorem 3 that R is 
z^-reducible. 

To prove necessity, assume that R is :^-reducible. By Theorem 3, there exists a closed 
set C with i^(C) > 0. Using the reversibility of R, we have 

(_R{e,c)v{Ae)= [ R{e,c)v{Ae) = Q. 

JC Jc 

This, of comse, implies that R{9,C) = for t^-a.e. 9 G C. Now, define Fi — {x G 
X:Q{C\x) > 0} and F2 ^ {x e X:Q{C\x) > 0}. Since Q{C\x) + Q(C\x) = 1 for every 
a; £ X, we have -Fi U F2 = X. Consequently, F2 C Fi. Since C is closed, we know that for 

any 9 eC, 

= i?(6i,C)= / Q(C\x)Pidx\e) = [ Q{C\x)P{dx\9). 
Thus, P{F2\9) = for all 9eC. Similarly, for v-a.e. 9eC,we have 

= R{9,C)= [ QiC\x)P{dx\9) = I Q{C\x)P{Ax\9). 

Jx J Fx 

Therefore, P{F\\9) = for v-a^. 6I e C and since F2 C Fi, it follows that P{F2\9) = 
for v-a.e. 9_e C. Letting A = Fa, we have P{A\9) = for aU 6* e C and PiA\9) = for 
v-n.e. 9eC. □ 

Obviously, a sufficient condition for i^-irreducibility of R is the non-existence of the sets 
A and C in Theorem 4. This is precisely what Theorem 2 says. However, as will become 
clear from the examples in the next section, even when the sets A and C do exist, it is 
often the case that some versions of R are i^-irreducible. One way to establish local-r^- 
recurrence (of all versions) of R is to identify a single version of R that is t^-irreducible and 
then show that this version of R is recurrent. The result then follows from the equivalence 
of recurrence and local- i^-recurrence (under irreducibility) mentioned in Section 1. 



4. Examples 

In this section, we illustrate the use of Theorem 4 with two examples. 
Example 1. Let X = = R and P{dx\9) =p{x\9)dx, where 

P{X\9) ^ Il^f, g^^){x) 

and where da; denotes Lcbesgue measure on X. Take the prior distribution to be i'{d9) = 
d9. A simple calculation shows that the marginal measure is A/(da;) = da;, which is 
clearly cr-finitc. This is all the information we require to apply Theorem 4. Let C €E B{Q) 
be a non-empty set such that i^{C) > 0. We claim that there exist 9' £ C and D C C 
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such that jy{D) > and \9 - 0'\ < 1/4 for every 6* G D. To see this, let Di = [|, ^) 
for all i G Z :={..., —1,0,1, .. .}. Then, Q = IJjgx ^i- there exists an such that 
C n Dig is not empty and z/(C n Dig) > 0, then we can simply take 9' to be any point 
in C n Dig and D to be the set C D Dig. Otherwise, for every i G Z, cither Di C C ot 
v{C n Di) = 0. Since v{C) > 0, there must exist an such that v{C n Dig) > and it 
follows that Dig C C. Assume, without loss of generality, that Cfl [^,oo) is non-empty 
and let ii = min{i > zq : C D Diis non-empty}, which is clearly finite. Now, any point in 
CnDi^ and the set Di^^i play the roles of 9' and D. These arguments show that there 
exist 9 £ C and 9' G C such that \9 — 9'\ < l/A, where 9 can be chosen outside of any 
subset of C having Lebesgue measure zero. It follows that ii Ii = {9,9 + 1), I2 = {9' ,9' + 1) 
and / = /i n I2, then v^I) > 0. Now, if there exists an A G B(X) such that P{A\9) = 
and P(A\9')=0, then 

!/(/) = iy{A nl) + v{A r\I)<v{Ar\Ii) + v(A n /a) = 0, 

which is a contradiction. Hence, such an A cannot exist and it follows from Theorem 4 
that every version of Eaton's Markov chain is j/-irreducible. 

For the sake of comparison, we now explain what is required to establish irreducibility 
in this situation if we make no appeal to Theorem 4. A version of the posterior is given 
by Q{<19\x) = q{9\x) <19, where 

(Z(0|x)=/(,_i,,)(0). 

It follows that R{9,drj) =r{ri\9)drj, where 

r{i^\9) = (1 + (7? - f?))/(-i,o) (?? - + (1 - (7? - (?))/(o,i) (7? - 9). 

Since is a location parameter in the density r{r]\9), the Markov chain W can be ex- 
pressed as a random walk 

Wn+l=Wn + Zn+l, 

where Zi, Z2, ... is an independent and identically distributed (i.i.d.) sequence of random 
variables with density given by 

/(2) = (1 + Z)/(_1,0)(Z) + (1-Z)/(0,1)(2). 

For any e G (0, 1), we have 

P(ZiG(0,e)) = P(ZiG(-e,0))>0. 

This implies that the chain W can make arbitrarily small jumps in either direction. While 
this argument makes it intuitively clear that the chain is 7^-irreducible, a formal proof 
requires a technical argument similar to that used in Section 4.3.3 of Meyn and Tweedie 
[11]. 

It turns out that this random walk is recurrent, which implies that W is locally- 1/- 
recurrent. Hence, by Theorem 1, v is strongly admissible. In fact, Eaton [3] shows that. 
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under very mild conditions, Lebesgue measure is a strongly admissible prior for one- and 
two-dimensional location problems. This concludes Example 1. 

Example 2. Let 9 = := [0, oo) and X = M" . Suppose that when > 0, the statistical 
model P{(ix\9) has a density (with respect to Lebesgue measure on X) given by 

n ^ 

p(x-|6i) = J|-/[o,e)(a;,;), 

4=1 

where x = {xi, . . . , a;„). In words, our statistical model stipulates that Xi, . . . , are i.i.d. 
random variables from the uniform distribution on [0,0). Take the prior distribution to 
be ^{dO) = where d9 denotes Lebesgue measure on 8. While we have yet to define 
P{dx\9) in the case where = 0, from a practical (statistical) standpoint this definition 
is irrelevant since i'({0}) = 0. However, technically speaking, this distribution must be 
specified to complete the model. (Note that we cannot simply remove the point {0} from 
8 because (0, oo) is not a Polish space.) We consider two alternatives for P(dx|0): 

1. a unit point mass at (0, . . . , 0) G M"; 

2. n i.i.d. exponential random variables with unit scale. 

We now apply Theorem 4. In case 1, there does exist a i^-reducible version of R since 
we can take A to be the point (0, . . . , 0) S M" and C = {0}. However, in case 2, the sets 
A and C do not exist. Indeed, let /z denote Lebesgue measure on X and note that it is 
impossible to satisfy the conditions of Theorem 4 if ijl{A) = since this yields P{A\9) = 1 
for all € 8. Now, if fi(A) > and ^(^16*) = 0, then it must be true that 6* > and 
n(Ar\[0,9)") = 0. Similarly, if 61* > and P{A\9*) = 0, then /i(A n [0, 6**)") = 0. Now, let 
9q = mm{d,9*} and note that 

Ai([o, 9or) = ^^{A n [0, 9or) + ^i(A n [o, 9or) < n [o, r )") + fi(A n [o, 9)") = o. 

This is a contradiction, which implies that the sets A and C do not exist. It follows that 
every version of R is j/-irrcduciblc. Note that, by defining the statistical model carefully 
on an irrelevant (t^-nuU) set of ^'s, we were able to employ Theorem 4 to show that all 
versions of R arc ;/-irrcduciblc. 

Regardless of how P{dx\0) is defined, the marginal measure is given by 

M{dx)^^, 
nx, N 
(") 

where a;(„) := max{a;i, . . . ,a;„} and dec denotes Lebesgue measure on X. Consider case 1 
again. For x such that a;(„) > 0, define 

nx? N 

9(^l^) = ^W,.oo)(^). 

Since the point (0, . . . , 0) e M" has A/-measure 0, Q{d9\x) can essentially be chosen arbi- 
trarily when X(^„) = 0. We consider two different choices. Let 6o{d9) denote the probability 
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measure concentrated at {0} and let Si{d9) denote a probability measure with support 
K+. (It seems more appropriate to take Q{d9\x) equal to So{d9) when X(„) = 0.) Two 
different versions of the posterior distribution are given by 



for i G {0, 1}. The version of Eaton's chain associated with Qq is z^-reducible since, if the 
chain is started at 6* = 0, it stays there forever. On the other hand, Eaton et al. [7] show 
that the version associated with Qi is j/-irreducible and go on to show that this chain is 
recurrent. Consequently, this version of Eaton's chain is locally- j/-recurrent and it follows 
from Theorem 1 that v is strongly admissible. This concludes Example 2. 

Appendix: On the measurability of Q 

Here, we establish the measurability of Q. Fix B e B{Q). It suffices to show that, for any 
t e M, the set 



The set Gj = {x e )^:Q{B\x) < i} S iB(X) since Q{B\-) is a measurable function. The 
measures Q and Q agree on Z?, hence 

Gtr\~D = {x eD:Q{B\x) <t} = {x eD:Q{B\x) <t}^GtnDe B(X). 

It remains to show that Gt fl Z) G B{X). There are four possible cases: 

1. 00 eB and t< 1; 

2. 6*0 gS andt>l; 

3. 00 ^B and t < 0; 

4. 00 (^B and t > 0. 

In the first two cases, Q{B\x) = 1 for all x E D. Hence, in the first case, Gt flZ? = G B{X), 
and in the second, GtC\ D = D E B{X). In the last two cases, Q{B\x) = for all x E D. 
Hence, in the third case, Gt fl D = G B{X), and in the last case, GtCiD = D e B{X). 
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Gt^{xEX:Q{B\x)<t} 
is in B{X). We will accomplish this using the partition 



Gt = iGtnD)UiGtnD). 



652 



J. P. Hobert, A. Tan and R. Liu 



References 

[1] Billingsley, P. (1995). Probability and Measure, 2nd ed. New York; Wiley. MR1324786 

[2] Eaton, M.L. (1982). A method for evaluating improper prior distributions. In Statistical 
Decision Theory and Related Topics III (S.S. Gupta and J.O. Berger, eds.) 1. New 
York: Academic. MR0705296 

[3] Eaton, M.L. (1992). A statistical diptych: Admissible inferences-recurrence of symmetric 
Markov chains. Ann. Statist. 20 1147-1179. MR1186245 

[4] Eaton, M.L. (1997). Admissibility in quadratically regular problems and recurrence of sym- 
metric Markov chains: Why the connection? J. Statist. Plann. Inference 64 231-247. 
MR1621615 

[5] Eaton, M.L. (2001). Markov chain conditions for admissibility in estimation problems with 

quadratic loss. In State of the Art in Probability and Statistics ~ A Festschrift for 

Willem R. van Zwet (M. de Gunst, C. Klaassen and A. van der Vaart, eds.). The IMS 

Lecture Notes Series 36. Beachwood, Ohio: IMS. MR1836563 
[6] Eaton, M.L. (2004). Evaluating improper priors and the recurrence of symmetric Markov 

chains: An overview. In A Festschrift to Honor Herman Rubin (A. Dasgupta, ed.). The 

IMS Lecture Notes Series 45. Beachwood, Ohio: IMS. 
[7] Eaton, M.L., Hobert, J. P. and Jones, G.L. (2007). On perturbations of strongly admissible 

prior distributions. Ann. Inst. H. Poincare Probab. Statist. To appear. 
[8] Hobert, J. P., Marchev, D. and Schweinsberg, J. (2004). Stability of the tail Markov chain 

and the evaluation of improper priors for an exponential rate parameter. Bernoulli 10 

549-564. MR2061443 

[9] Hobert, J. P. and Robert, C.P. (1999). Eaton's Markov chain, its conjugate partner and 

P-admissibility. Ann. Statist. 27 361-373. MR1701115 
[10] Hobert, J. P. and Schweinsberg, J. (2002). Conditions for recurrence and transience of a 

Markov chain on Z+ and estimation of a geometric success probability. Ann. Statist. 

30 1214-1223. MR1926175 
[11] Meyn, S.P. and Tweedie, R.L. (1993). Markov Chains and Stochastic Stability. London: 

Springer. MR1287609 

Received December 2006 and revised April 2007 



